Papers with gradient-based domain adaptation of self-attentive neural machine translation models
Compact Personalized Models for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | a large proportion of model parameters can be frozen during adaptation with minimal or no reduction in translation quality. |
| Approach: | They propose gradient-based domain adaptation methods for self-attentive machine translation models . they encourage structured sparsity in the set of offset tensors during learning . |
| Outcome: | The proposed method achieves high space and time efficiency using sparse models . the results compare the proposed method with incremental adaptation . |